Center for Open Access in Science « https://www.centerprode.com/ojer.html 
cOA s Open Journal for Educational Research, 2021, 5(2), 207-222. 
= ISSN (Online) 2560-5313 « https://doi.org/10.32591/coas.ojer.0502.07207d 











Development of Distance Education Attitude Scale 
for Teachers: A Study of Validity and Reliability 


Serpil Deniz 
Ministry of Education, Gaziantep, TURKEY 


Birsen Bagceci 
Gaziantep University, Faculty of Education, TURKEY 


Received: 18 August 2021 = Accepted: 19 October 2021 = Published Online: 8 November 2021 


Abstract 


The purpose of this study is to examine the validity and reliability of the Distance Education 
Attitude Scale for Teachers, which was developed to reveal teachers’ attitudes towards distance 
education during the COVID-19 outbreak. Statistical analyses were performed on 458 of the 
collected forms. The study group was randomly divided into two and the EFA process was 
conducted with 205 participants and the CFA process with 253 participants. KMO and Bartlett 
tests were performed to determine the suitability of the data for EFA. The KMO value was 0.0885 
and the Bartlett test was statistically significant (y2=3141, df=703, p<0.001). EFA results show 
that the DEASFT structure consists of 21 items and two factors, and these factors are named as 
“Benefits of Distance Education” and “Limitations of Distance Education”. CFA was applied on 
the data of 253 different people to the factor structures obtained as a result of AFA Analyses. One 
item was dropped from the scale because p values (0.178) is bigger than 0.05. According to fit 
indices (y2/df < 1.5, CFI=0.953 > 0.9, TLI=0.942 > 0.9, SRMR=0.0735 < 0.8, RMSEA=0.0427 
< 0.05), the scale is validated. The final version of scale has two factors and 20 items. Cronbach 
Alpha and composite reliability coefficients were calculated for reliability. For factor 1 Cronbach 
a=0.847 and McDonald’s w=0.836. For factor 2 Cronbach a=0.815 and McDonald’s w=0.845. 
The results of the analysis show that the scale is a valid and reliable measurement tool for 
determining teachers’ attitudes towards distance education. 
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1. Introduction 


The COVID-19 epidemic, which causes sudden and unpredictable changes globally in 
very serious dimensions, has led to problems in all countries in social, economic, psychological 
and many other areas. Even if it is called “the new normal”, this epidemic, which causes the whole 
world to experience abnormal times and seriously changes the daily routine of people, has brought 
many necessary changes. Although the rhythm of the COVID-19 epidemic, which began in 
December 2019, has changed from time to time, it has shown its most devastating effect in the 
health sector and then in the education sector (Yamamoto & Altun, 2020). The epidemic, which 
cannot be controlled, has stopped the flow of life worldwide, caused millions of schools to be closed 
indefinitely and brought the education system of countries to a halt (Zhao, 2020). Strict 
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prohibitions such as curfews, travel restrictions, and the closure of social places where people 
come together to prevent the COVID-19 epidemic have been implemented in most countries. But 
the most serious and drastic measures have shown themselves in the field of education. During 
the mandatory isolation process, schools were closed in 191 countries at all levels around the 
world, and the educational life of about 1.6 billion students was disrupted (UNESCO, 2020). With 
90% of the students in the world staying away from school and being closed to home, the serious 
deficiency in education caused by the epidemic has mobilized all countries of the world. In order 
to minimize the negative impact of the epidemic on all educational stages from first grade to higher 
education, each country has created strategies within its own capabilities, changed its educational 
policies and had to develop urgent practices (Belay, 2020; Fernando & Schleicher, 2020). For the 
purpose of avoiding further interruption of Education, various distance education activities have 
started to be used in all countries of the world (Yamamoto & Altun, 2020). Different tools, 
assignments, updated and structured contents and alternative training models were used in these 
programs to continue the interrupted training (Zhao, 2020). The increasing threat of the epidemic 
has required countries to take urgent decisions to prevent learning losses while trying to protect 
their students, teachers and staff from the virus (Hodges at al., 2020). 


Although many experts have argued about the negative effects of distance education 
such as unhealthy graduates (Lau, Yang & Dasgupta, 2020) and changing in assessment (Cahapay, 
2020), technical problems will reduce the effectiveness and efficiency of education (Anderson & 
Dron, 2011), students who are distant to technology will spend time on the use of educational tools 
rather than the course itself (Miltiadou & Yu, 1999), or the communication barriers between 
students and teachers that may occur during the course (Perreault et al., 2002), due to curfews 
and closed schools, distance education has become not an option but an obligation all over the 
world (Yamamoto & Altun, 2020). 


Distance education programs, which have been used for many years especially in 
higher education throughout the world and in Turkey, have become a mandatory situation for 
students and teachers studying at all levels, from primary schools to universities with the outbreak 
of COVID-19 (Durak et al., 2020). This situation has radically changed the educational life not 
only for students who have been educated face-to-face for years, but also for teachers (Lall & Singh, 
2020). These major changes have also raised concerns such as access inequality, communication 
problems, technical difficulties, increased workload and stress, difficulty assessing student 
participation, and poor work-life balance (Abu Talib et al., 2021). From the point of view of 
students and teachers, the idea emerged that education is not exactly the same as classical distance 
education, due to a lack of time and resources in accessing information about distance education, 
lack of necessary equipment and technological infrastructure, and the presence of negative 
psychological factors caused by the epidemic (Yildirim, 2020). In various national and 
international sources, the new education process and the applied distance education model that 
emerged with the COVID-19 crisis have been described as “Emergency Remote Education” 
(Affouneh et al., 2020; Bozkurt & Sharma, 2020a; Hodges et al., 2020). This new definition has 
been described as an exceptional situation that cannot be considered as normal education for 
teachers, students and parents in the shadow of the epidemic (Aguliera & Nightengale-Lee, 2020; 
Milman, 2020). It has been emphasized in many sources that emergency distance education is 
different from known distance education. Emergency remote education includes not only physical 
distance, but also the concepts of interactional and psychological distance, is unplanned, is created 
quickly to be applied in the crisis process, is applied temporarily, brings problems such as 
technological infrastructure, participation, economic situation experienced by learners and 
teachers, and arises from necessity, not preference (Bozkurt, 2020; Bozkurt & Sharma, 2020b; 
Carter et al., 2020; Hodges at al., 2020). 


According to the report of the Ministry of Education of Turkey (2019) with the 
outbreak of COVID-19, education was the most affected institution by the crisis with about 18 
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million students and 950 thousand teachers (Bakioglu & Cevik, 2020). November 23 March 2020 
in Turkey, the emergency distance education model first started to be implemented through 3 
television channels and Educational Information Network (EBA) connected to TRT, the process 
continued with live lessons as it progressed, and from November it was decided to continue all 
official, private, formal and widespread educational activities through distance education. 
Considering that the transition to emergency distance education takes place quickly and 
unprepared, it cannot be said that teachers, students and parents are psychologically fully 
prepared for their technological and physical infrastructure needs. As a matter of fact, research 
has shown that students and teachers are weak in terms of digital skills and technological support 
needed to pass the distance education process effectively and efficiently (Alipio, 2020; Bozkurt, 
2020; Basaran et al., 2020). However, it is known that in the epidemic process, the issue is not 
only technical, but also many pedagogical difficulties (Ali, 2020). It is also important that students 
and teachers have a positive perception of the program as well as having the necessary 
technological infrastructure and the knowledge and skills required by education for the successful 
and healthy implementation of distance education. Because it is important that this sudden digital 
transformation with the epidemic occurs simultaneously with not only a_ technological 
transformation, but rather a mental transformation (Bozkurt, 2020). In affective characteristics 
that are important for learning, the individual’s attitudes have a great influence (Erden, 1995; 
Gardner, 1985; Tavsancil, 2005), studies have revealed that attitude affects learning in virtual 
environments where distance education is carried out (Sanders & Morrison-Shetlar, 2001). 


For a successful distance education application; considering that teachers’ perceptions 
are of great importance (Tzivinikou et al., 2020), the attitude of the individual towards his / her 
job affects job performance (Kahramanoglu et al., 2018), and teachers’ attitudes are also reflected 
in students (Aydin & Saglam, 2012), it is important to determine and evaluate teachers’ attitudes 
towards distance education during the emergency distance education process. Teachers’ interest 
in distance education, their thoughts and feelings about the program, and how they evaluate 
distance education greatly affect the implementation process of the program. It is known that 
successful distance education can only be achieved with teachers who can provide quality 
education (Tabata & Johnsrud, 2008) and individual beliefs about knowledge, learning and 
teaching are interconnected (Bay et al., 2015). For all these reasons, it has become a need to 
determine teachers’ attitudes towards distance education, who have an important role as the 
practitioner of the program. 


There are many studies that examine attitudes towards distance education in national 
and international fields. But most of the work done in Turkey has been done with students or 
academics in higher education (Eygii & Kahraman, 2013; Kisla, 2016; Arslan, et al., 2019; Celik & 
Uzunboylu, 2020). A glimpse of research literature reveals that a little research studies on 
attitudes towards distance education have been carried out on primary, secondary and high school 
teachers working within the Ministry of education in Turkey (Agir, 2007; Ayyildiz et al., 2006). 
None of the studies have been carried out in order to evaluate the perceptions of teachers for 
emergency distance education, which is enforced by teachers at all levels during a crisis like 
COVID-19, their preparation for distance teaching, the problems and needs they face in their 
teaching processes. It is necessary to analyze the current situation first in order to determine the 
functioning of the applied emergency distance education program, the problems experienced, the 
needs and the solution proposals. Determining the attitudes of teachers who are the practitioners 
of emergency distance education is of great importance in terms of conducting studies to reduce 
their existing negative attitudes, bringing to light the problems brought by the program and 
helping to solve them. This study was carried out in order to develop a valid and reliable scale to 
determine the attitudes of teachers working in schools affiliated to the Ministry of Education in 
Turkey and switching to urgent distance education within the scope of measures taken during the 
COVID-19 epidemic. 
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2. Methodology 


This study is a valid and reliable scale development study to determine the attitudes 
of teachers towards immediate distance education implemented during the COVID-19 epidemic. 
This scale development study was carried out in the fall semester of the 2020-2021 academic year 
in Turkey. 


2.1 Sample 


The study’s working group consists of 502 teachers working in private or public 
schools in the Ministry of National Education of Turkey. After the missing forms were eliminated, 
the remaining 458 data were analyzed. In scale development studies, the number of sample groups 
is important for validity and reliability studies. As well as the size of the sample, it is also important 
that it is diverse to represent the target audience (Tezbasaran, 2008). It is stated in the literature 
that the number of participants should be five or ten times the number of items in the scale (Child, 
2006; Nunnally, 1978). However, Nunnally (1978) found that a sample group of 300 people was 
sufficient in scale development studies, Comrey and Lee (1992) stated that 50 people are very poor, 
100 people are low, 200 people are medium, 300 people are good, 500 people are very good and 
1000 people are a perfect number. In the light of this information, it can be said that the total 
number of 458 participants in the study is a good number for the scale development study. The 
demographic variables of the study group are given in Table 1. 


Table 1. Demographic variables of the sample 








Frequencies (f) Percentage (%) 

Gender Female 2908 65.1 

Male 160 34.9 
Type of School Public School 391 85.4 

Private School 67 14.6 
Grade Primary School 43 9.4 

Secondary School 134 29.3 

High School 281 61.4 
Total 458 100 





The study group of the research consists of a total of 458 teachers, 298 (65.1%) females 
and 160 (34.9%) males. 391 of the teachers in the study group are in public school and 67 are in 
private school; 43 of them are teachers working in primary school, 134 in middle school, 281 in 
high school. 


2.2 Development process of attitude scale 
This scale development work consists of five stages. 


In the first stage; In order to determine the items of the distance education attitude 
scale and how to develop the attitude scale, national and international attitude scale studies 
towards distance education have been carefully examined (Celik & Uzunboylu, 2020; Kisla, 2016; 
Eygii & Kahraman, 2013; Ayyildiz, at al., 2011; Tzivikov, at al., 2020; Kumari & Sood, 2018; 
Mahmoud Raba, 2013). In addition, written answers were obtained from 92 teachers by using a 
form consisting of open-ended questions prepared online in order to learn teachers’ opinions and 
feelings about distance education. After reviewing the relevant literature and analyzing the 
teachers' opinions, an item pool of 46 items consisting of half positive and negative statements 
was created. 
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In the second stage; In order to ensure the validity of the content of the scale, the 
opinions of 4 experts in the field were consulted and they were asked to evaluate the clarity of the 
structure, the level of interest, the accuracy, the excess of the structure and the “suitability” of the 
structure. According to the feedbacks of the experts, after calculating the A-CVI and UA for each 
item, 8 items were removed from the scale and some items were edited (Yusoff, 2019; Polit, 2007). 


In the third stage; The scale items were examined with a language expert in terms 
of spelling, grammar rules and expression disorders and re-evaluated individually. The scale was 
applied to 12 teachers in order to evaluate its intelligibility and no changes were made since there 
were no items that were not understood by the teachers. The prepared draft form is designed as a 
Likert type scale with 5 options. The degrees included in the scale are 1 (strongly disagree), 2 
(strongly disagree), 3 (ambivalent), 4 (agree), 5 (strongly agree). As a result of the regulations, a 
draft form consisting of 20 negative and 18 positive items was obtained. 


In the fourth stage; The final draft of the 38-item attitude scale was applied to 502 
teachers to calculate the validity and reliability of the attitude scale. A total of 502 teachers working 
in private or public schools under the Ministry of Education of Turkey, in different schools, at 
different levels and in various branches, were applied online. After the missing forms were 
eliminated, the remaining 458 data were analyzed. 


In the last stage; Jamovi (1.6.9) software was used in descriptive and deductive 
analyses at the stage of psychometric properties of the scale in the study. In scale development 
studies, it was emphasized that performing EFA and CFA studies with different groups would yield 
more effective results (Fabrigar at al., 1999; Worthington & Whittaker, 2006). In this scale 
development study, the 458-person study group was randomly divided into two, and Exploratory 
Factor Analysis (EFA) studies were conducted with 205 participants and Confirmatory Factor 
Analysis (CFA) studies with 253 participants. The validity and reliability analysis were carried out 
with the whole study group. Before conducting factor analysis, factorability was studied, which 
determines whether the data collected is sufficient to develop factors. The Kaiser-Meyer-Olkin 
Measure of Sampling Adequacy (KMO) and Barlett’s test was checked. The KMO value varies 
between 0 and 1. An index above 0.50 suggests factor analysis (Williams, Brown & Onsman, 2010). 
First, the Kaiser-Mayer-Olkin (KMO) and Bartlett’s Test were performed to determine the 
suitability of the data for factor analysis. Exploratory Factor Analysis (EFA) and Confirmatory 
Factor Analysis (CFA) were applied to the scale, which is suitable for factor analysis. AFA is a 
multivariate statistical method that allows the researcher to create an accurate map of the factors 
and structures associated with the events studied (Edwards & Bagozzi, 2000; Watkins, 2018). 
Exploratory Factor Analysis, as factor rotation method, varimax with Kaiser normalization was 
used. 


During scale development and validation, CFA is conducted to improve items while 
examining the nature and relationships of structures. Since the structural model is created with 
DFA, a definitive hypothesis can be created about the cases being studied (Jackson, Gillaspy & 
Purc-Stephenson, 2009). Confirmatory factor analysis was applied to examine the goodness of fit 
and construct validity of the 2-factor scale, which was formed as a result of the exploratory factor 
analysis applied to the scale. While performing CFA, indices such as Chi-square goodness of fit 
test, goodness of fit index (GFI), adjusted goodness of fit (AGFI), comparative fit index (CFD, 
normed fit index (NFI), standardized root mean square (SRMR) were analyzed and root mean 
square error of approximation (RMSEA) has been calculated. Secondly, Cronbach Alpha 
coefficient analysis and composite reliability calculations were performed to determine the 
reliability of the resulting scale. For a perfect reliability level, alpha values should be above 0.70 
(Kline, 2011; Lavrakas, 2008) and should not exceed 0.94 (Taber, 2018). 
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3. Findings 


The KMO value of the analysis was .885, which is considered very good and the Bartlett 
test was statistically significant (y2=3141, df=703, p<0.001). Results of KMO and Barlett’s test 
appear to support the validity of the factor analysis usage for this study. After these analyses, 
Exploratory Factor Analysis and Confirmatory Factor Analysis were performed on the data 
obtained from the attitude scale. 


3.1 Exploratory factor analysis of the scale 


Exploratory Factor Analysis, as factor rotation method, varimax with Kaiser 
normalization was used. The exploratory factor analysis was administered the 38 items. Items 
with an eigenvalue of 1.00 were retained. In addition, substances (a) loaded into more than one 
factor, (b) loaded factor is not consistent with the meaning of other substances, and (c) <0.35 
factor load is obtained substances were deleted (Deng, Wang, Guan & Wang, 2017; Asgharnezhad, 
et al., 2020). Eigenvalues and scree plots were examined to determine the number of factors. The 
results of EFA showed that the scale grouped under 2 factors with eigenvalues larger than 1. 
Fundamental axis factor analysis and Varimax rotation technique were used to make the factor 
structures stronger. After using varimax rotation, the factor loadings for each item were examined 
and loadings of less than 0.40 were eliminated. Since items 6, 8, 14, 21, 27, 30, 34, 35 and 36 had 
extraction values below 0.40, they were removed from the scale. Factor analysis was subsequently 
redone with 29 items. Later, items in multiple dimensions, that is, items with a factor load under 
both factors were examined. Item 5 with values below the critical value and items 1, 15, 16, 32 and 
38 were present under multiple dimensions were also removed from the scale. KMO and Bartlett 
tests were performed again, as the irrelevant and overlapping materials were cleared. According 
to the analysis result, KMO value was calculated as 0.872, Bartlett test result as y2=1379, df=210 
and p<o.001. The results are very good, and EFA can be tested with data based on the remaining 
substances. Eigenvalues and scree graphs were examined to determine the number of factors. The 
results obtained from EFA made over 21 items; The scree graph is given in Figure 1, the eigenvalues 
table in Table 2, and the variances and total variance of the factors in Table 3. 


Eigenvalue 


a ee 
_——)— 
a 
— —_ 
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Factor 


Figure 1. Scree plot of the scale 


As can be seen in Figure 1, since there are two eigenvalues greater than 1, a two-factor 
structure has emerged. 
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Table 2. Table of eigenvalues of the scale 




































































Factors | Eigenvalues 
1 5.10235 
2 2.18130 
3 0.38539 
4 0.24054 
5 0.20098 
6 0.15939 
Z 0.08734 
8 0.04447 
9 -0.00724 
10 -0.09475 
11 -0.12163 
12 -0.15024 
13 -0.16694 
14 -0.22197 
15 -0.25111 
16 -0.30884 
17 -0.32866 
18 -0.35860 
19 -0.38917 
20 -0.41538 
21 -0.48479 














When the values in Table 2 were examined, the eigenvalue was calculated as 5.10 in 
the first factor and 2.18 in the second factor. The scree plot and the eigenvalues table of the scale 
also support that the scale consists of two factors. 


Table 3. The variances and total variances of the factors 





Factors | Total Load | Percentage of variances | Percentage of Total Variances 





1 4.04 19.2 19.4 




















2 3.52 16.8 36.0 





The scale consisting of 2 factors and 21 items describes 36% of the total variance when 
examining the factor structures given in Table 3. According to the correlation calculation between 
factors, these factors measure different structures. The correlation value is r=0.0605 and is not 
statistically significant. 


Table 4. Factor structures and loadings of the 21 items 
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17 It is easy for me to be able to teach from anywhere in distance | 0.697 0.506 
education. 
26 I enjoy my distance education lessons. 0.684 0.411 
23 I enjoy teaching lessons by using the visual materials I want in | 0.584 0.655 
distance education. 
24 I am happy to learn new information about the use of technology | 0.583 0.608 
in the distance learning process. 
28 Distance education enables me to explain the subjects more | 0.580 0.601 
fluently. 
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10 I would like to continue distance education when the normal | 0.553 0.596 
process starts. 

19 I like to research content for use in Distance Education. 0.552 0.695 

7 Distance education saves me time and money. 0.522 0.702 

18 It is important for me to reach many students at the same time | 0.516 0.733 
with distance education. 

37 I believe that distance education gives students the responsibility | 0.512 0.687 
of learning. 

13 It makes me happy to be able to reach my students, even from a | 0.454 0.791 
distance. 

4 It is easier to provide effective classroom management in distance | 0.431 0.741 
education. 

11 Not getting feedback from students in distance education courses 0.708 | 0.488 
bothers me. 

20 I do not like being unable to identify the passive student in 0.657 | 0.566 
distance education courses 

9 I don't like not being able to communicate one-on-one with 0.649 | 0.570 
students in distance education lessons. 

29 I am afraid that my students do not understand the subject in 0.590 | 0.625 
distance education. 

12 I don't like teaching lessons dependent on the screen. 0.583 | 0.519 

3 I think that distance education is not as accepted as face-to-face 0.544 | 0.688 
education. 

31 I don't like not knowing students in distance education. 0.500 | 0.731 

22 I am disturbed by the technical problems I experience in distance 0.485 | 0.752 
education. 

33 The uncertainty of the distance learning process makes it difficult 0.447. | 0.776 
for me to make a lesson plan. 





As can be seen in the factor analysis results given in Table 4, it was concluded that the 
items were grouped under two factors, the factor load values were sufficient and each item 
represents the factor in which it is located. It is observed that the load values of substances vary 
between 0.431 and 0.708. As a result of the exploratory factor analysis, 21 items were distributed 
over 2 factors; factor 1 includes eleven items and factor 2 includes nine items. After the factor 
analysis, one of the important steps is to measure the common structure of the items collected in 
the same factor. In the scale we have obtained, items 4, 7, 10, 13, 17, 18, 19, 23, 24, 26, 28, and 37 
in the first factor clearly measure teachers' attitudes towards the advantages and contributions of 
distance education. Therefore; this factor was named as “Benefits of Distance Education (BDE)”. 
The second factor, which consists of 3, 9, 11, 12, 20, 22, 29, 31, and 33 items, measures teachers’ 
attitudes towards disadvantages of distance education, so the second factor is named as 
“Limitations of Distance Education (LDE)”. The items in the scale created were both structurally 
and semantically consistent. 


3.2 Confirmatory factor analysis of the scale 


When the first model fit indices are examined, it is seen that the CFI and TLI values 
are above 0.9, the SRMR value is lower than 0.08 and the RMSEA value is less than 0.05. 
Accordingly, the DFA value of the scale is acceptable. 
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Table 5. Model-1 parameter estimates of the scale 




























































































Factors | Items Beta SE Z p Corrected 
Item-Total 

Correlation 

Factor1 | 17 0.6241 | 0.0703 | 8.88 | <.001 0.628 
26 0.7573 | 0.0700 | 10.82 | <.001 0.725 

23 0.5458 | 0.0685 7.97 | <.001 0.577 

24 0.2559 | 0.0578 | 4.43 | <.001 0.355 

28 0.5768 | 0.0677 | 8.52 | <.001 0.596 

10 0.6472 | 0.0860 7.53 | <.001 0.546 

19 0.4227 | 0.0641 6.59 | <.001 0.482 

7 0.4331 | 0.0893 | 4.85 | <.001 0.362 

18 0.5450 | 0.0680 | 8.02 | <.001 0.588 

37 0.5219 | 0.0778 6.71 | <.001 0.481 

13* 0.0741 | 0.0551 1.35 | 0.178 0.111 

4 0.5331 | 0.0842 6.33 | <.001 0.476 

Factor 2 | 11_T 0.5834 | 0.0566 | 10.30 | <.001 0.666 
20_T 0.5907 | 0.0694 8.51 | <.001 0.568 

9_T 0.6347 | 0.0543 | 11.69 | <.001 0.755 

29_T 0.6976 | 0.0642 | 10.87 | <.001 0.708 

12_T 0.6905 | 0.0652 | 10.60 | <.001 0.680 

oral: 0.3780 | 0.0459 | 8.24 | <.001 0.553 

31 T 0.5808 | 0.0658 | 8.83 | <.001 0.585 

2007 0.4541 | 0.0603 7.53 | <.001 0.527 

33 iT 0.6074 | 0.0764 7.95 | <.001 0.552 





*Not significant at the 0.05 level. 


However, since the Z value between Factor 1 and item 13 was not at a statistically 
significant level, DFA was repeated by removing 13. Finally, in the analysis of the 20-item scale, 
the necessary modifications were made by taking the first analyses into account, and the final 
result was obtained. The model created for CFA analysis is given in Figure 2. 












































Figure 2. Item factor relationship 
Table 6. Fit indices for the models 





RMSEA 90% CI 
x2/df CFI TLI SRMR | RMSEA | Low High 
210/152<1.5 | 0.953 | 0.942 | 0.0735 | 0.0427 | 0.0273 | 0.0562 
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When the model fit indices are examined, it is seen that the CFI and TLI values are 
above 0.9, the SRMR value is lower than 0.08 and the RMSEA value is less than 0.05. According 
to these results, it is seen that all fit indices have acceptable values. It can be said that the model 
is compatible with factors and data when examining fit indices. Based on this, it was concluded 
that the model and scale items were appropriate. 


Table 7. Parameter estimates of the scale 




































































Factors | Items Beta SE Z Pp Corrected Item- 
Total Correlation 

Factor1 | 17 0.626 | 0.0703 8.90 | <.001 0.630 
26 0.756 | 0.0701 | 10.77 | <.001 0.723 

23 0.550 | 0.0686 8.01 | <.001 0.580 

24 0.246 | 0.0589 4.18 | <.001 0.342 

28 0.573 | 0.0685 8.37 | <.001 0.592 

10 0.644 | 0.0872 7.39 | <.001 0.544 

19 0.436 | 0.0643 6.77 | <.001 0.497 

7 0.433 | 0.0900 4.81 | <.001 0.362 

18 0.549 | 0.0682 8.05 | <.001 0.591 

37 0.529 | 0.0783 6.75 | <.001 0.488 

4 0.533 | 0.0845 6.31 | <.001 0.476 

Factor 2 | 11 0.583 | 0.0567 | 10.28 | <.001 0.665 
20 0.591 | 0.0694 8.53 | <.001 0.568 

9 0.635 | 0.0544 | 11.67] <.001 0.755 

29 0.701 | 0.0641 | 10.93 | <.001 0.712 

12 0.691 | 0.0652 | 10.59 | <.001 0.680 

3 0.377 | 0.0459 8.22 | <.001 0.552 

31 0.579 | 0.0658 8.80 | <.001 0.584 

22 0.453 | 0.0604 7.50 | <.O001 0.525 

33 0.606 | 0.0764 7.92 | <.001 0.551 


























As seen in Table 6, all Z values are at a statistically significant level of 0.05. So, all the 
items involved are related to the factors. The validity of the 2-factor scale structure revealed by 
confirmatory factor analysis and exploratory factor analysis was confirmed. Based on all these 
findings we obtained after the confirmatory factor analysis, it was concluded that the Attitude 
Scale towards Distance Education is a valid scale. 


3.3 Reliability of the scale 


For reliability calculations, Cronbach Alpha calculations based on EFA sample and 
also composite reliability (McDonald’s w) calculation based on CFA sample analysis was 
performed. Table 7 summarizes factor names, number of the items and reliability of each factor. 


Table 8. Reliability calculations according to scale factors and total scores 

















Factors Name Number of Cronbach a | McDonald’s w 
Items 

Benefits of Distance Education (BDE) 11 0.847 0.836 

Limitations of Distance Education 

(LDE) 9 0.815 0.845 

Total Scale 20 0.861 0.872 

















According to the results of the analysis, the scale consisted of two factors: the benefits 
and limitations of distance education. In both reliability calculations, it is considered sufficient to 
be above 0.7. As seen in table 7, it was determined that Cronbach alpha and McDonald’s value of 
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each factor is above 0.7. Also, it was found that Cronbach alpha value of total scale is 0.861 and 
McDonald’s value of the total scale is 0.872. According to these results, it can be said that Distance 
Education Attitude Scale is a valid and reliable scale. 


4. Discussions and conclusions 


In this study, a reliable and valid scale study was conducted to measure the attitudes 
of primary, secondary and high school teachers associated with the Ministry of Education in 
Turkey towards Distance Education during the COVID-19 crisis. The scale created is an easily 
applicable scale to measure teachers’ attitudes towards distance education, which is carried out 
not only during the epidemic process, but also later for various reasons. It is obvious that distance 
education models, which became mandatory during the epidemic, made a sudden entrance into 
the lives of every teacher and student around the world and accelerated the digital transformation 
in education. It is anticipated that even if schools are opened, distance education practices can 
partially continue, and will be used as a second option to maintain education in times of regional 
or national problems. It is believed that the presence of a scale that evaluates teachers’ attitudes 
towards distance education will be very useful for identifying deficiencies in distance education 
programs and organizing and developing existing programs. It is also believed that positive 
teacher attitudes will help improve the quality and efficiency of distance education. 


When the relevant literature is examined, it is seen that scale studies have been carried 
out to evaluate the attitudes of especially university students or academicians towards distance 
education. There has not been enough work on a scale prepared for teachers at all levels for 
emergency distance education implemented during the COVID-19 outbreak. 


The scale of attitude towards distance education was carried out in five stages. After 
the literature review and evaluation of the opinions of teachers received, an item pool was created. 
In order to determine the content validity of the measurement tool as a result of the expert 
evaluations, Item-Content Validity Index (I-CVI), Scale Level-Content Validity Index Average (S- 
CVI/Avg.) And Scale-Content Validity Index Universal Agreement (A-CVI/UA) was analyzed and 
items not I-CVI=1 were excluded from the scale (Yusoff, 2019). S-CVI/Avg. of the scale 0.967 and 
A-CVI / UA 0.870, so the results are above the acceptable level (Polit & Beck, 2006). As a result of 
expert evaluations, calculations were made for each item and a 38-item draft form of the scale was 
created. The scale was applied to 458 teachers working at different levels and schools. This number 
can be considered very good for scale development studies according to various sources (Child, 
2006; Nunnally, 1978; Comrey & Lee, 1992). For the validity and reliability calculations of the 
scale, EFA and CFA were performed, respectively. As a result of EFA analysis, a two-factor attitude 
scale consisting of 21 items was obtained. The load values of the items range from 0.431 to 0.708. 
It has been concluded that the factor load values of items are sufficient and represent the factor in 
which each item is located. The factors of the scale are named as “Benefits of Distance Education 
(BDE)” and “Limitations of Distance Education (LDE)”. Factors explain 36% of the total variance. 
According to the correlation calculation between factors, these factors measure different 
structures. Examining teacher attitudes regarding the benefits and challenges of distance 
education is particularly important for the development of programs. 


CFA was applied to the factor structures obtained after EFA. An item was removed 
from the scale because p values (0.178) were greater than 0.05. The scale was verified according 
to calculated fit indices. Looking at the fit indices of the model; Chi-square statistic (y2/df)=1.5 
value is less than 3; The RMSEA (0.0427) value is less than 0.06; SRMR (0.0735) value is less 
than 0.08; The CFI value of 0.953 showed an acceptable fit. After AFA and DFA analyses, a two- 
factor and 20-point scale was obtained. Cronbach Alpha and composite reliability coefficients 
were calculated for reliability. Cronbach a=0.847 and McDonald’s w=0.836 were found for the 
first factor and Cronbach a=0.815 and McDonald’s w=0.845 were found for the second factor and 
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these numbers represent a perfect reliability level (Kline, 2011; Lavrakas, 2008; Taber, 2018). 
While the high Cronbach Alpha internal consistency coefficient (0.861) of the scale shows that the 
items are consistent with each other, the results of EFA and CFA have also proven the validity of 
the scale. As a result of the study, considering the validity and reliability calculations, it can be said 
that the attitude scale towards distance education can be used in studies to determine teachers’ 
attitudes. The attitude scale developed in this study will fill the gap in the literature related to 
determining teachers’ attitudes towards distance education. 
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